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ABSTRACT 

The Wilkinson Microwave Anisotropy Probe (WMAP) has measured lower amplitudes 
for the temperature quadrupole and octopole anisotropics than expected in the best 
fitting (concordance) A-dominated cold dark matter (ACDM) cosmology. Some au- 
thors have argued that this discrepancy may require new physics. Yet the statistical 
significance of this result is not clear. Some authors have applied frequentist argu- 
ments and claim that the discrepancy would occur by chance about 1 time in 700 
if the concordance model is correct. Other authors have used Bayesian arguments to 
claim that the data show marginal evidence for new physics. I investigate these con- 
fusing and apparently conflicting claims in this paper using a frequentist analysis and 
a simplified Bayesian analysis. On either analysis, I conclude that the WMAP results 
are consistent with the concordance ACDM model. 
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1 INTRODUCTION 



The WMAP satellite (Bennett et al. 2003a; Hinshaw et al. 
2003; Spergel et al. 2003) has led to a precise measurement of 
the temperature anisotropy power spectrum, Ce, from mul- 
tipoles £ — 2 to £ ~ 600. The observed temperature power 
spectrum is in striking agreement with the predictions of the 
'concordance' inflationary ACDM cosmology with parame- 
ters consistent with those inferred from observations made 
prior to WMAP (compare, for example, Wang et al. 2002 
and Spergel et al. 2003). 

However, as pointed out by the WMAP team there may 
be a discrepancy between the predictions of the ACDM mod- 
els and the observations at low multipoles. A low amplitude 
of the CMB quadrupole was first found by COBE (Hin- 
shaw et al. 1996), but the new WMAP observations have 
led to a more accurate measurement and to tighter control 
of systematic errors caused by residual foreground emission 
from the Galaxy. The amplitude of the octopole measured 
by WMAP is also low compared to the best fitting ACDM 
model and the temperature autocorrelation function C(6) 
shows an almost complete lack of signal on angular scales 
^ 60 degrees. Spergel et al. (2003, hereafter S03), quantify 
the latter discrepancy by computing the statistic 



S = 



1/2 



[C{6)] 2 dcosf 



(1) 



for a large number of simulated skies generated from the 
posterior distribution of the ACDM cosmology. They con- 
clude that the probability of finding a value of S smaller than 
that observed is about 1.5 x 10~ 3 . This low probability, if 
correct, suggests a discrepancy between the ACDM cosmol- 
ogy and the observed low CMB multipoles, indicating a need 



for new physics. Indeed, a number of authors have explored 
various models that might reproduce the low quadrupole 
and octopole. For example, S03 and Tegmark, de Oliveira 
Costa and Hamilton (2003) suggest that the effect might be 
associated with the small size of a finite universe, while Ef- 
stathiou (2003a) and Contaldi et al. (2003) have proposed 
a cut-off in the primordial power spectrum associated with 
spatial curvature. Cline, Crotty and Lesgourgues (2003) and 
Feng and Zhang (2003) consider multi-field inflation mod- 
els, while DeDeo, Caldwell and Steinhardt (2003) consider 
quintessence models with an equation of state that leads to 
a partial cancellation of the usual integrated Sachs- Wolfe ef- 
fect. Evidently, theorists are not short of ideas that might 
account for the observations. 



But is new physics necessary? Is the probability of 
1.5 x 10 -3 derived in S03 correct, or has the significance 
of the discrepancy been overestimated? Do modified models 
provide statistically significantly better fits to the data than 
the concordance ACDM model? Some of the recent litera- 
ture on these points is confusing. For example, Bridle et al. 
(2003), Cline et al. (2003) and Contaldi et al. (2003) perform 
Bayesian analyses of the WMAP data to test whether the 
low multipoles require a sharp break in the primordial spec- 
trum. Although the data favour a break at a wavenumber 
k c ~ 3 x 10 _4 Mpc _1 , the concordance model with k c = 
is not strongly excluded. Is this conclusion compatible with 
the S03 analysis of the S statistic? The questions raised 
in this paragraph are addressed in this paper. Tegmark et 
al. (2003) comment on a possible alignment between the 
quadrupole and octopole. This effect is ignored in this pa- 
per, which focuses exclusively on the statistical significance 
of the amplitudes of the quadrupole and octopole. For an 
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analysis of the statistical significance of alignments, see de 
Oliveira-Costa et al. (2003). 



2 OBSERVATIONS AND FIDUCIAL 
CONCORDANCE MODEL 

It has become common to use Monte-Carlo Markov Chains 
(MCMC) to evaluate the posterior distributions of cosmo- 
logical parameters given observations of the CMB power 
spectra and their covariance matrices (see Christensen et al. 
2001; Lewis and Bridle 2002; Verde et al. 2003). As a fiducial 
model, we follow the MCMC analysis of Bridle et al. (2003) 
and adopt a spatially flat ACDM cosmology specified by 
6 parameters, a constant scalar spectral index n s , spectral 
amplitude A Sl Hubble constant h = //o/(100kms _1 Mpc _1 ), 
baryon density uji, = Q,^h 2 , CDM density u> c = Q c h 2 and 
redshift of reionization z e s- Tensor modes are ignored in 
this analysis. The input CMB data consists of the WMAP 
temperature and temperature-polarization cross-correlation 
power spectra (and associated programmes to compute the 
likelihood function, see Verde et al. 2003) supplemented with 
measurements at higher multipoles (800 £ £ 2000) from 
CBI (Pearson et al. 2003), ACBAR (Kuo et al. 2003) and 
VSA (Grainge et al. 2003). 

Figure 1 shows a histogram of the quadrupole ampli- 
tudes from a set of MCMC chains* for this six parame- 
ter model. The peak occurs at a quadrupole amplitude of 
AT| « 1250 fiK 2 (AT/ = 1(1 + l)C e /(2n)) and the distri- 
bution is quite narrow; few samplings have quadrupole am- 
plitudes smaller than 1000 fiK 2 or greater than 2000 /iK 2 . 
As a fiducial model, we set h = 0.72, n s = 1.0, ui b = 0.024 
and lo c = 0.12 and choose z e g so that the optical depth for 
Thomson scattering is r = 0.17. These numbers are very 
close to those that give the maximum likelihood to the data 
used to generate Figure 1, but some have been adjusted 
slightly so that they are consistent with other data, e.g. 
the HST key project measurement of the Hubble constand 
(Freedman et al. 2001). The quadrupole and octopole am- 
plitudes for this fiducial model are AT 2 = 1140 fiK 2 and 
AT 2 = 1060 fiK 2 . To illustrate the sensitivity to the param- 
eters of the fiducial model, we will show how various results 
change if the quadrupole and octopole amplitude are low- 



ered to AT 2 2 = 1000 /iK 2 and AT| = 930 /iK 2 , i.e. towards 
the lower end of the allowed range according to Figure 1. 

The WMAP quadrupole and octopole amplitudes in the 
publicly available data release are given as AT 2 2 = 123 fiK 2 
and AT 2 = 611 /iK 2 . The quadrupole amplitude in par- 
ticular (shown by the dashed line in Figure 1) is much 
lower than the amplitude of the fiducial ACDM model. The 
Bennett et al. (2003a) WMAP summary paper lists the 
quadrupole amplitude as 154 ± 70 /xK 2 , slightly higher than 
the value in the public data release. The error on this num- 
ber is a 95% confidence limit on the uncertainty associated 
mainly from modelling foreground Galactic emission. (For 
comparison, the quadrupole amplitude measured by COBE 
is AT 2 2 = 240 ±\f A ^K 2 , Hinshaw et al. 1996). Full details 
of how the WMAP team arrive at this error estimate have 



* The chains have been made available by Antony Lewis at the 
following web site http://cosmologist.info/cosmomc/. 
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Figure 1. The histogram shows the quadrupole amplitudes 
for a sample of MCMC chains for a six parameter ACDM fit 
to WMAP+CBI+ACBAR+VSA data. The vertical dashed line 
shows the quadrupole amplitude observed by WMAP. 



not yet been published, but it would seem to be reasonable 
since Tegmark et al. (2003) find a quadrupole amplitude of 
202 nK 2 (including the small ~ 4/iK 2 contribution from the 
kinematic quadrupole) from an analysis of their all-sky fore- 
ground subtracted WMAP map. Tegmark et al. (2003) find 
an octopole amplitude of 866 piK 2 from their all-sky map. 
We adopt these numbers (which for the quadrupole is at the 
upper end of the Bennett et al. error range) to illustrate 
the effects of systematic uncertainties associated with con- 
tamination by Galactic emission. Tegmark et al. find similar 
numbers for an all-sky analysis of the WMAP internal linear 
combination foreground subtracted CMB map (Bennett et 
al. 2003b). 



3 FREQUENTIST STATISTICS 

In the absence of a sky cut and instrumental noise, the distri- 
bution of Ce estimates in a theory with Gaussian amplitudes 
atm follows a \ 2 distribution, 



exp 



(2£ + l)CA dC 



2CJ 



^F. (2) 

J i 



where Cj is the expectation value of Ce- Integrating equa- 
tion (2), the probability of observing a value < Ce is given 
by 



P(< Ce) 



7 



/ 2i+i 21+1 Ch 
V 2 ' 2 cj 

rm 



(3) 



where 7 is the incomplete Gamma function. 

In practice, the actual distribution depends on the es- 
timator of Ce, the shape of any Galactic cut and, of course, 
instrumental noise and other sources of error. Figure 2 shows 
a histogram of quadrupole amplitudes determined by apply- 
ing a pseudo-CV estimator (see e.g. Hivon et al, 2002) to a 
large number of simulated noise-free maps generated using 
the power spectrum of the fiducial ACDM model discussed 
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Table la: Frequentist estimates of the Quadrupole and Octopole Discrepancy 



(AT 2 ) T (AT|) T P(AT| < 123) P(AT| < 611) P(AT| < 123, P(AT| < 202) P(AT 2 < 870) P(AT| < 202, 

AT| < 611) AT| < 870) 

1140 1060 0.013 0.24 0.0032 0.036 0.44 0.016 

1000 930 0.017 0.31 0.0054 0.046 0.53 0.025 



Table lb: Bayesian estimates of the Quadrupole and Octopole Discrepancy 



AT| 


ATf 


P((AT|) T > 1140) 


P((AT 2 ) T > 1060) 


P((AT|) T > 1000) 


P((AT|) T > 930) 


123 


611 


0.087 


0.45 


0.10 


0.53 


202 


870 


0.16 


0.66 


0.19 


0.73 



Note: Table la gives the frequencies that the observed amplitudes ATj and AT 2 will be less than the specified values (expressed in 
fjK 2 ) if the true amplitudes are (AT 2 ) T and (AT 2 ) T (see Section 3). Table lb gives the Bayesian frequencies that the observed values 
of quadrupole and octopole amplitudes are drawn for a model with true quadrupole and octopole amplitudes greater than (ATj ) T and 
(AT 2 ) T (see Section 4). 



in the previous section. The Kp2 Galactic cut imposed by 
Hinshaw et al. (2003) was used in the simulations. Figure 2 
shows the resulting distribution of quadrupole amplitudes, 
together with a x 1 distribution (see also Wandelt, Hivon, 
Gorski, 2001). The effects of Galactic cuts on pseudo-CV 
estimators is discussed in detail by Efstathiou (2003b, c), 
however, for the modest Galactic cuts used in the analysis of 
WMAP, the quadrupole amplitude is weakly correlated with 
higher multipoles and its distribution follows a \ 2 distribu- 
tion quite accurately with a variance that is only marginally 
greater than the cosmic variance. 

The corresponding frequentist statistics are given in Ta- 
ble 1(a) and agree with equation (2) to within about 50%. 
From this Table, we see that the probability of observing a 
quadrupole lower than 123/iK 2 is about 1.3% and that the 
joint probability of finding quadrupole and octopole ampli- 
tudes smaller than those observed is about 0.32% which is 
about twice the value inferred by S03 from their analysis of 
the S statistic. In fact, S03 compare the S statistic with sim- 
ulations generated from their MCMC chains. If we rescale 
the quadrupole and octopole amplitudes of our simulations 
so that the amplitudes follow the MCMC distribution plot- 
ted in Figure 1, the joint probability for the quadrupole and 
octopole amplitudes drops from 0.32% to 0.21% only slightly 
larger than the value of 0.15% deduced by S03 from the S 
statistic. Given that the integration range of the S statistic 
was chosen a posteriori, it is not suprising that S03 find a 
slightly more significant discrepancy. The main conclusion to 
draw from this analysis is that the significance level deduced 
by S03 from the S statistic is understandable; a similar sig- 
nificance level is deduced from the quadrupole and octopole 
amplitudes alone. Most of the weight in the S statistic is 
coming from the quadrupole and octopole amplitudes and 
any 'a posteriori bias' in the statistic is small. t 




AT 2 2 ( M K) 2 

Figure 2. Histogram of quadrupole amplitudes estimated using 
a pseudo-C< estimator applied to 10 5 simulations with a Galactic 
cut of ±10° centred on the Galactic plane. The power spectrum 
of the fiducial ACDM model discussed in Section 2 was used to 
generate the simulations. The solid line shows a \ 2 distribution 
(equation 2) and the dashed line shows the quadrupole amplitude 
measured by WMAP. 

Table la also lists the frequentist probabilities if 
the quadrupole and octopole amplitudes are 202/iK and 
870piK 2 respectively, which we have argued in Section 2 
are within the allowed range given uncertainties in sub- 
tracting Galactic foregrounds. (The analysis of the WMAP 
temperature-polarization power spectrum, C TE , shows clear 
evidence for a Galactic polarized signal (Kogut et al. 2003). 



t We note here that Gaztafiaga et al., 2003, find much higher 
probabilities by applying a frequentist statistic to estimates of 
C(0) from WMAP using a conservative Galactic cut. Their results 
are puzzling, however, because: (i) they find that their statistic 



is extremely sensitive to the size and shape of the Galactic cut; 
(ii) their results are inconsistent with the pseudo-C^ estimator 
used by the WMAP team and the quadratic maximum likelihood 
estimator used by Efstathiou (2003c). 
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Figure 3. Unnormalised Bayesian probability distributions for the quadrupole and octopole amplitudes given by equation (5). The 
dashed lines show the values for the fiducial ACDM model discussed in Section 2. 



Since the systematic errors in C TE from Galactic emission 
have not yet been quantified fully, and since the randon er- 
rors are large, we ignore the WMAP C TE measurements 
in the rest of this paper.) The joint probability of find- 
ing quadrupole and octopole amplitudes below these values 
given the fiducial ACDM model is 1.6%, i.e. about 5 times 
greater than the value deduced for quadrupole and octopole 
amplitudes of 123piK 2 and 611^iK 2 , an order of magnitude 
greater than deduced by S03 from the S statistic. If the pa- 
rameters of the ACDM model are adjusted to give values for 
the quadrupole and octopole amplitudes that lie towards the 
lower end of the allowed range, the joint probability for the 
quadrupole and octopole rises to 2.5%. We conclude that it 
is premature to rule out the ACDM cosmology because of 
the low quadrupole and octopole amplitudes. The true val- 
ues of the quadrupole and octopole for our CMB sky have 
not yet been determined with a sufficiently high accuracy, 
and the theoretical expectations of the A cosmology are not 
constrained tightly enough, to exclude the model at a high 
significance level. The S03 analysis of the S statistic exag- 
gerates the statistical significance of any discrepancy with 
the ACDM model because they did not consider errors in the 
autocorrelation function arising from innacurate subtraction 
of Galactic emission. 



4 BAYESIAN STATISTICS 

As mentioned in the Introduction, a number of papers (e.g. 
Bridle et al. 2003, Contaldi et al. 2003, Cline et al. 2003) 
have applied Bayesian methods to analyse more complex 
models, for example, ACDM models with a sharp break or 
truncation in the initial power spectrum on large scales. 
These papers ignore the possible systematic errors in the 
WMAP power spectra discussed above, yet even so they 
report no strong evidence for the introduction of any addi- 
tional parameters. How is this conclusion compatible with 
the S03 analysis of the S statistic or the simple frequentist 



tests described in the previous Section? In this Section we 
provide an answer by applying Bayes' theorem to an inten- 
tionally simple model. 

According to Bayes' theorem, the posterior probability 
of hypothesis H given the data D is 

P{H\D) oc P(D\H)P(H), (4) 

where P(D\H) is the probability of the data D given H 
and P{H) is the prior probability of H . Let us adopt the 
hypothesis that the true amplitude Cj lies in the range Cf± 
dCf , then applying equation (4) and assuming a uniform 
prior for Cj , the posterior probability distribution for Cj 
is 

dP{Cj) « ^yurrexp (-^p) dCj, (5) 

where Ce is the observed amplitude. Equation (5) is pro- 
portional to the likelihood function, which has its maximum 
value at Cj = Ce- The distributions (5) are plotted for the 
quadrupole and octopole in Figure 3. 

The distributions plotted in Figure 3 give the posterior 
probabilities that the true amplitudes Cj take on any par- 
ticular value and so we can use these figures to test how 'dis- 
connected' the observed values of C2 and C3 (corresponding 
to the peaks of the probability distributions) are from those 
of the fiducial model (indicated by the vertical dashed lines) . 
The ratio of these probabilities is p(C2)/p((Cj)fld = 28 and 
p(C , 3)/p((C| , )fld = 1.6; neither of these ratios is high and 
so we conclude that the observed amplitudes do not provide 
strong evidence against the fiducial ACDM model. 

Why do these numbers indicate a weaker rejection of 
the model than the frequentist statistics of Table la? Let us 
recast the Bayesian analysis in frequentist language. Imagine 
that we draw values of (Cj) from a uniform distribution 
between and an upper limit (Cj) m ax (the exact value of 
this maximum limit is unimportant as long as it extends well 
into the tail of the distribution (2)). For each draw, generate 
a random value of Ce from the \ 2 distribution (2) and for 
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those values that lie within a narrow interval around the 
observed value of Ci compute the frequency with which Cj 
exceeds a critical value (Cj) cr it. This frequency is just the 
integral over the probability distribution (5) 

P (Cf > (Q T ) cri t) =/ dP{Cj), (6) 

hcj) CIit 

(where the upper limit (C^) max has been replaced by infin- 
ity) . Numerical values for these frequencies for the octopole 
and quadrupole (neglecting minor effects from a cut sky) 
are given in Table lb for values of (Cf) C rit) equal to those 
of the fiducial model and for values at the low end of the 
range found from the MCMC chains. The latter numbers are 
the more useful because if these frequencies turn out to be 
low, then there is little overlap between the posterior distri- 
butions of Figure 3 and the distributions of quadrupole and 
octopole amplitudes from the MCMC chains. This would 
force us to reject the concordance ACDM model. 

However, we find that the frequency with which 
(A^) 2 > lOOO^K 2 , given the observed WMAP quadrupole 
of 123/iK 2 is only 0.10, and so again we conclude that the 
evidence against the ACDM model is marginal. Of course, 
this test is different to the frequentist test discussed in Sec- 
tion 3 (Table la), but it is easy to understand why the two 
tests give different impressions of a discrepancy. We can see 
from Figure 2 that the probability of finding a quadrupole 
amplitude as low as that observed, given the fiducial model, 
is not improbably small and so if we assume a uniform prior 
for Cj, low values of Cj simply do not have enough weight 
to exclude the quadrupole amplitude of the fiducial model 
at high significance. 

Since varies from zero to infinity, should we not have 
used Jeffreys' prior (Jeffreys 1939, Jaynes 2003), dCf/Of, 
thus giving extra weight to low values of Cj ? No, be- 
cause there is a natural scale for Cf\ namely the amplitude 
of the fiducial model (Cj)^- In any reasonable physical 
model, it is impossible to get a quadrupole amplitude that 
is very much smaller than that of the fiducial model because 
C'2 involves an integral of the perturbation spectrum over 
wavenumber k. Since there is strong evidence in favour of 
the fiducial model for wavenumbers k Si 10~ 3 Mpc _1 (Bri- 
dle et al. 2003) we should strongly disfavour models with 
very low values of Cj. The assumption of a uniform prior 
over the range, say, ~ 10 _1 (Cl^tid to a few times (Cj)^ 
is physically reasonable and relatively benign, although (as 
with all of the Bayesian analyses referred to in this paper) 
we must recognise that there is some dependence of the pos- 
terior probabilities on the form of the prior. 

In conclusion, the Bayesian frequencies given in Table 
lb provide a meaningful comparison of the fiducial ACDM 
model to the WMAP data and they indicate marginal evi- 
dence for any discrepancy. In the opinion of this author, the 
Bayesian analysis is preferable to the frequentist analysis of 
Section 3 which is, in any case, inconclusive because of sys- 
tematic errors in the quadrupole and octopole amplitudes. 
The Bayesian frequencies listed in Table lb could be mis- 
leading only if there is persuasive evidence that the priors on 
C2 and should be strongly skewed towards much smaller 
values than those of the fidicual model, in which case the low 
amplitudes observed by WMAP add little new information. 



5 CONCLUSIONS 

(i) Do the WMAP measurements of the quadrupole and oc- 
topole amplitudes conflict with the ACDM cosmology? Based 
on the quadrupole and octopole amplitudes, the answer is 
unambiguously no. The frequentist tests discussed in Section 
3 are inconclusive because there are significant systematic 
errors in the WMAP quadrupole and octopole amplitudes. 
These errors were neglected in S03's analysis of the S statis- 
tic and hence their estimate of a 1 in 700 chance of reproduc- 
ing the observations according to the concordance ACDM 
model is an overestimate of the true odds. The Bayesian 
analysis of Section 4 suggests that a more reasonable esti- 
mate of the odds is more like 1 in 10 or 1 in 20. Whatever 
your statistical orientation, there is no convincing evidence 
for a discrepancy with the concordance ACDM model. 

(ii) Do the WMAP measurements of the quadrupole and 
octopole amplitudes require new physics? Despite point (i) 
above, the likelihood functions plotted in Figure 3 peak at 
lower values than those of the fiducial ACDM model and 
so will favour models which predict low quadrupole and oc- 
topole amplitudes, provided that the number of extra pa- 
rameters required to describe the models is not too large^" As 
an example, consider the analysis of Bridle et al. (2003) of a 
ACDM model with an initial spectrum truncated sharply be- 
low a wavenumber k — k c (see their Figure 2). The WMAP 
data favour a truncation at k c ~ 3 x 10 _4 Mpc _1 , thus 
favouring new physics, but (consistent with the results of 
this paper) a model with k c = is not strongly excluded. 
We conclude that the WMAP data certainly warrant explo- 
ration of models incorporating new physics, but these mod- 
els had better make other testable predictions if they are 
ever to be strongly preferred over the concordance ACDM 
model. 

(Hi) Can measurements of the low CMB multipoles be im- 
proved? As mentioned in Section 2, Bennett et al. (2003a) 
quote an error on the quadrupole amplitude of ±70/iK 2 
and state that this is caused largely by errors in subtract- 
ing foreground emission. This error estimate is consistent 
with the difference in the quadrupole amplitude measured 
by Tegmark et al. (2003), who use a different method to 
subtract Galactic emission. It may, therefore, be possible to 
improve on the accuracy of the quadrupole, and other low 
CMB multipoles, by applying better methods of foreground 
subtraction. 

More accurate estimates of the low multipoles can be 
obtained by applying an optimal estimator (see e.g. Tegmark 
1997) rather than the pseudo-C^ estimator used by the 
WMAP team. In the noise-free limit (a good approxima- 
tion for WMAP on large angular scales) , an optimal estima- 
tor will return almost the exact values of low multipoles on 
the cut sky, provided that the sky-cut is not too large. An 
analysis of this sort might establish whether AT| is closer 
to 100/iK 2 or 200^iK 2 , which would be useful, though as ex- 
plained in Section 4, the Bayesian analysis is not particularly 
sensitive to variations of this magnitude. § 

t This condition can be quantified using Bayesian methods, 
e.g. by computing Occam factors (Jaynes 2003, Chapter 20) or 
Bayesian evidence (see e.g. Saini, Weller and Bridle 2003). 
§ Such an analysis has been completed since this paper was sub- 
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